﻿ Natural Language Processing vs Logic Is logic useful in the computaonal interpretaon of language? Dan Cristea dcristea@info uaic ro Communicaon through language MFOI – Vadul lui Vodă, 29 July 2016 Communicaon through language thought MFOI – Vadul lui Vodă, 29 July 2016 Communicaon through language thought emoon MFOI – Vadul lui Vodă, 29 July 2016 Communicaon through language thought emoon MFOI – Vadul lui Vodă, 29 July 2016 Communicaon through language thought emoon MFOI – Vadul lui Vodă, 29 July 2016 Communicaon through language thought emoon MFOI – Vadul lui Vodă, 29 July 2016 Communicaon through language thought thought emoon MFOI – Vadul lui Vodă, 29 July 2016 Communicaon through language thought thought emoon emoon MFOI – Vadul lui Vodă, 29 July 2016 Logic and NL • Logic: the expression of rigour • Challenge of logical formalisms in NL: code any language expression in logical form • Usefulness: clear out ambiguies • Skepcs: to what extend can a message be encoded in logic? MFOI – Vadul lui Vodă, 29 July 2016 The logic of language communicaon …two horses… – the emier is a man, lives in England in 1926, a worker of the ﬁeld – the receiver is this man’s master è – both emier and receiver have a common knowledge on the word horse – the emier knows that the receiver has the same meaning as himself on horse – the emier intends to make the receiver build the representaon: S = {x⏐horse(x)} ^ card(S) = 2, where: card(S): the cardinal of the set S, horse(x): a qualifying funcon asserng that x belongs to a class of objects sharing the semanc property that is currently denominated in English by the word horse, and that the pragmac context in which the expression is uered clearly separates the diﬀerent meanings that this English word may encode MFOI – Vadul lui Vodă, 29 July 2016 When is logic of help… MFOI – Vadul lui Vodă, 29 July 2016 Chunks level: Generave Lexicon and Qualia Structures J Pustejovsky The Generave Lexicon Cambridge, MA: MIT Press, 1995 • meaning of words decomposed on 4 coordinates: – Formal (F): encoding taxonomic informaon about the lexical item (the is-a relaon); – Constuve (C): encoding informaon on the parts and constuon of an object (part-of or made-of relaon); – Telic (T): encoding informaon on purpose and funcon (the used-for or funcons-as relaon); – Agenve (A): encoding informaon about the origin of the object (the created-by relaon) MFOI – Vadul lui Vodă, 29 July 2016 Qualia Structures • Represent meaning of composions of words – large car (F = vehicle), – broken car (C = motor), – speedy car (T = drive), – Italian car (A = made in Italy) MFOI – Vadul lui Vodă, 29 July 2016 What skepcs grump? • How to master the enormous range of possible combinaons? • Has likes the same meaning? – He likes my sister vs He likes vanilla ice cream MFOI – Vadul lui Vodă, 29 July 2016 Discourse level: meaning of sequences of sentences Maria dropped the egg from her hand She cleaned the ﬂoor MFOI – Vadul lui Vodă, 29 July 2016 To link sentences we make inferences Maria dropped the egg from her hand MFOI – Vadul lui Vodă, 29 July 2016 To link sentences we make inferences Maria dropped the egg from her hand MFOI – Vadul lui Vodă, 29 July 2016 To link sentences we make inferences Maria dropped the egg from her hand MFOI – Vadul lui Vodă, 29 July 2016 To link sentences we make inferences Maria dropped the egg from her hand MFOI – Vadul lui Vodă, 29 July 2016 To link sentences we make inferences Maria dropped the egg from her hand MFOI – Vadul lui Vodă, 29 July 2016 To link sentences we make inferences Maria dropped the egg from her hand She cleaned the ﬂoor MFOI – Vadul lui Vodă, 29 July 2016 To link sentences we make inferences Maria dropped the egg from her hand She cleaned the ﬂoor MFOI – Vadul lui Vodă, 29 July 2016 To link sentences we make inferences Maria dropped the egg from her hand She cleaned the ﬂoor MFOI – Vadul lui Vodă, 29 July 2016 To link sentences we make inferences Maria dropped the egg from her hand She cleaned the ﬂoor MFOI – Vadul lui Vodă, 29 July 2016 To link sentences we make inferences Maria dropped the egg from her hand She cleaned the ﬂoor MFOI – Vadul lui Vodă, 29 July 2016 To link sentences we make inferences Maria dropped the egg from her hand She cleaned the ﬂoor MFOI – Vadul lui Vodă, 29 July 2016 To link sentences we make inferences Maria dropped the egg from her hand She cleaned the ﬂoor MFOI – Vadul lui Vodă, 29 July 2016 To link sentences we make inferences Maria dropped the egg from her hand She cleaned the ﬂoor MFOI – Vadul lui Vodă, 29 July 2016 To link sentences we make inferences Maria dropped the egg from her hand drops(AG:Maria, OB:egg) => falls(REC:egg) => touches(AG:egg, OB:X) Qualia Formal(egg) = container; Qualia Constuve(egg) = {eggshell(fragile),liquid} => breaks(REC:eggshell) => leaks(REC:liquid, ON:X) => perceives(AG:Maria, OB:dirty(X)) She cleaned the ﬂoor => cleans(AG:Maria, OB:ﬂoor) => perceives(AG:Maria, OB:dirty(ﬂoor)) MFOI – Vadul lui Vodă, 29 July 2016 To link sentences we make inferences Maria dropped the egg from her hand She cleaned the ﬂoor MFOI – Vadul lui Vodă, 29 July 2016 To link sentences we make inferences Maria dropped the egg from her hand She turned the light on MFOI – Vadul lui Vodă, 29 July 2016 Discourse level: variability in language Meaning Variability Ambiguity Language MFOI – Vadul lui Vodă, 29 July 2016 Discourse level: variability in language • Reduce the distance between form and meaning are: Informaon Retrieval (IE), Textual Entailment (TE) and Queson Answering (QA) MFOI – Vadul lui Vodă, 29 July 2016 Textual Entailment • Text t entails hypothesis h (t⇒h) if humans reading t will infer that h is most likely true A true entailment • t: …a shootout at the Guadalajara airport in May, 1993, that killed Cardinal Juan Jesus Posadas Ocampo and six others • h: Cardinal Juan Jesus Posadas Ocampo died in 1993 MFOI – Vadul lui Vodă, 29 July 2016 Textual Entailment … and of a false one • t: Regan aended a ceremony in Washington to commemorate the landings in Normandy • h: Washington is located in Normandy MFOI – Vadul lui Vodă, 29 July 2016 How is entailment checked? • t: Philanthropic Golding Inc came into existence in January 2004 One year aer its foundaon the company declared bankruptcy • h: Philanthropic Golding Inc bankrupted in January 2005 MFOI – Vadul lui Vodă, 29 July 2016 How is entailment checked? • Launch a pipeline of processes, at the end of which the sentences of both t and h are expressed in a symbolic form that allows close comparison MFOI – Vadul lui Vodă, 29 July 2016 How is entailment checked? Philanthropic Golding Inc came into existence in January 2004 • Step1: tokenisaon (not shown), part-of- speech tagging (not shown), chunking noun phrases and clashing mul-word expressions Philanthropic Golding Inc came into existence MFOI – Vadul lui Vodă, 29 July 2016 How is entailment checked? • Step 2: recognion of enty menons, of me expressions and resoluon of anaphora Philanthropic Golding Inc is a named enty January 2004 January 2004 is a temporal expression MFOI – Vadul lui Vodă, 29 July 2016 How is entailment checked? • Step 3: funconal dependency parsing; here we show a Universal Dependency (UD) coding MFOI – Vadul lui Vodă, 29 July 2016 How is entailment checked? • Step 4: me analysis, in which EVENT and TLINK elements, formalizing the events and their temporal relaons, are generated The caming into existence of Philanthropic Golding Inc is an event The moment of this event is the one coded by the temporal expression January 2004 MFOI – Vadul lui Vodă, 29 July 2016 How is entailment checked? • Step 5: equivalent structures (transformaons) and computaon of transive closures of temporal relaons: equivalence of the expressions: X comes into existence and UNKNOWN founds X è The caming into existence of Philanthropic Golding Inc can equally be expressed by a founding event in which PGI has the object role The moment of this event is the one coded by the temporal expression January 2004 MFOI – Vadul lui Vodă, 29 July 2016 How is entailment checked? One year aer its foundaon the company declared bankruptcy • Step 1: NP-chunking its foundaon the company bankruptcy MFOI – Vadul lui Vodă, 29 July 2016 How is entailment checked? • Step 2: NER, Timex and AR one year one year is a temporal expression its and the company are coreferenal with Philanthropic Golding Inc its foundaon is recognised as an event coreferenal with the founding of Philanthropic Golding Inc banckrupcy is recognised as an event MFOI – Vadul lui Vodă, 29 July 2016 How is entailment checked? • Step 3: UD MFOI – Vadul lui Vodă, 29 July 2016 How is entailment checked? • Step 4: EVENT and TLINK elements declared bankruptcy Both acts of declaring bankruptcy and of bankruptcy itself involving Philanthropic Golding Inc are recognised as events The declaring bankruptcy event takes place one year aer the foundaon event MFOI – Vadul lui Vodă, 29 July 2016 How is entailment checked? • Step 5: the Time Closure tool The declaring bankruptcy event takes in January 2005 MFOI – Vadul lui Vodă, 29 July 2016 How is entailment checked? Philanthropic Golding Inc bankrupted in January 2005 • A similar processing chain produces: bankrupted An event of bankruptcy in which is involved Philanthropic Golding Inc January 2005 The moment of this event is January 2005 Other formalisms • Natural Logic: Tree structured Recursive Neural Networks can learn to idenfy logical relaonships such as entailment and contradicon… MFOI – Vadul lui Vodă, 29 July 2016 And when logic is of no use? MFOI – Vadul lui Vodă, 29 July 2016 Double negaon • Double Negaon languages (among which standard variees of Germanic and Scandinavian): – two negave elements cancel each other out resulng in a posive reading: Paul didn’t see nobody = Paul saw somebody “There is an individual x, such that Paul saw x ” A Falaus Romanian N-words as Negave Quanﬁers, Working Papers in Linguiscs, 31st Annual Penn Linguiscs Colloquium, Univ Pennsylvania, 2008 MFOI – Vadul lui Vodă, 29 July 2016 Double negaon • Negave Concord languages (among which Romanian and Italian): – mulple occurrences of negaon are interpreted as one semanc negaon: Paul n-a văzut pe nimeni = Paul didn’t see anybody “It is not the case that there is an individual x, such that Paul saw x ” MFOI – Vadul lui Vodă, 29 July 2016 Linear posion ambivalence • Associaons noun+adjecve vs adjecve+noun have diﬀerent meanings femeia singură => the woman alone singura femeie => the only woman A Cornilescu The linearizaon of the Romanian adjecves and the structure of the Romanian DP, in Torck D and Wetzles L (eds), Romance Languages and Linguisc Theory, 2006", John Benjamins, 2009 MFOI – Vadul lui Vodă, 29 July 2016 Linear posion ambivalence today 10 years ago mașina lui (cea) veche vechea lui mașină MFOI – Vadul lui Vodă, 29 July 2016 Linear posion ambivalence… • … does not apply to any adjecve: certain modiﬁers make sense only when situated in the pre-posion with respect to the modiﬁed noun biet (poor, piful) is not accepted unless it precedes the noun: biet om (poor man), but not: om biet M -D Vulchanova Modiﬁcaon in the Balkan nominal expression: An account of the (A)NA – AN(A) order contract In Marne Coene and Yves D’hulst (eds): From NP to DP: The syntax and semancs of noun phrases, John Benjamin, 2003 MFOI – Vadul lui Vodă, 29 July 2016 Linear posion • The intersecon-based composion contradicted: – if X (adj) and Y (noun), then X Y (or Y X): • set of objects Y that have the property X • intersecon between the set of objects having the property X and the set of objects Y è poor men: intersecon between the set of things which are poor and the set of men è sll, bieţii oameni: subset of the set of men which are in a piful/miserable state MFOI – Vadul lui Vodă, 29 July 2016 Contexts and the mist of pragmacs • Textual context: sense ﬁxed by the context • Disambiguaon computed stascally… Google Translate MFOI – Vadul lui Vodă, 29 July 2016 Textual context and word senses • Logic lacks power How would a logical soluon work? And if one exists, what would be the cost of the supporve lexical-semanc resources to generalise it? MFOI – Vadul lui Vodă, 29 July 2016 The wood language • Words induce diﬀerent reacons in humans: here humorous (contrary to the intenon) “Să luptăm pentru propăţirea neamului şi aducerea României pe cele mai înalte culmi de civilizaţie mullateral dezvoltată ” (approx Let’s ﬁght to thrive our srps and bring Romania on the highest peaks of mullaterally developed civilizaon ) R Zaﬁu Limba de lemn (The wood language) In Dilema veche, Nr 314 / 18-24 februarie, 2010 The wood language “Pus asel în lumină, ancorat în sinergia faptelor, recursul la universalitate nu eludează meandrele concretului ” (approx Thus put in light, anchored in the synergy of facts, the appeal to universality does not circumvent the meanders of the concrete ) aributed to Ion Iliescu MFOI – Vadul lui Vodă, 29 July 2016 Style in literature • Humans perceive co-occurrence of words as producing very suggesve images “constelația ochilor mei” (the constellaon of my eyes) “angi cu auzul” (approx your hearing touches) “nisipuri de ﬁară” (beast sands) Nichita Stănescu, Autoportret în mp de veghe (Auto portrait during watch me) MFOI – Vadul lui Vodă, 29 July 2016 Style in literature • Seizing emoons incurred by sentences like the following in logical expressions? "It’s enough for me to be sure that you and I exist at this moment ” Gabriel Garcia Marquez: One Hundred Years of Solitude MFOI – Vadul lui Vodă, 29 July 2016 Style in literature • Formalise in logical terms a metonymic sense of an expression? “lipindu-se de răcoarea tocului uşii” (approx scking to the chill of the door frame) Gabriel Garcia Marquez: One Hundred Years of Solitude A touched object is replaced with a sensaon that the agent borrows from that object MFOI – Vadul lui Vodă, 29 July 2016 Style in literature • Look for logical equivalent of metaphorical language: “Te mângâi cu degetele muiate în aminri ” (I caress you with my ﬁngers dipped in memories) MFOI – Vadul lui Vodă, 29 July 2016 Style in literature • Confronted with the extraordinary diversity of suggesons that words can convey, logic seems to me faint, forceless, impuissant • How could such poecal expressions be encoded in logical construcons? MFOI – Vadul lui Vodă, 29 July 2016 And the soluon is? • Logic proves successful in represenng many language aspects • There should be a limit where the ambion to express natural language in logical form has to stop because it reaches an insurmountable limit MFOI – Vadul lui Vodă, 29 July 2016 And the soluon is? • 4 categories of thinkers on the relaonship between language and logic – the logic purists: everything can be expressed in logical (symbolic) forms – the stascal-neural purists: everything can be expressed by stascs/neural formalisms – the skepcals: language can never be interpreted totally, neither by symbolic nor stascal means – the moderates, dirty workers: only a combinaon between the two paradigms can help, and this only to a certain limit MFOI – Vadul lui Vodă, 29 July 2016 Instead of conclusions • Their lack of conﬁdence in logic as a universal machinery for processing language comes from observaons of the inability of logic to support exhausvely the processing infrastructures of language • They don’t believe that each sentence, or each sequence of sentences, should be transformed into a theorem that necessitates a proof MFOI – Vadul lui Vodă, 29 July 2016 Instead of conclusions • Reasoning, that part of language use that necessitates volional connecons in order to decipher informaon, to ﬁnd explicit links, without which understanding would be impossible – yes • Primary processes that enable the use of language to express emoons, therefore that allow cognion based on language – no MFOI – Vadul lui Vodă, 29 July 2016 Thank you! MFOI – Vadul lui Vodă, 29 July 2016 